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Abstract 

Inter-domain  routing  for  MANETs  (Mobile  Ad  Hoc  Networks) 
draws  increasing  attention  because  of  military  and  vehicular 
applications.  The  existing  Border  Gateway  Protocol  (BGP)  is  the  de 
facto  inter-domain  routing  protocol  for  the  Internet  But  BGP  is  not 
applicable  to  MANETs  because  the  BGP  design  is  based  on  a  static 
Internet  which  does  not  support  dynamic  discovery  of  members^  and 
cannot  scale  to  mobile^  dynamic  topology  environments. 

The  proposed  geo-based  inter-domain  routing  (GIDR)  protocol 
obtains  efficient  communications  among  MANETs  and  achieves 
scalability  in  large  networks  by  using  geo-routing  packet  forwarding 
scheme  and  clustering  technique.  The  basic  structure  of  GIDR  is 
clusters  in  each  domain.  The  distributed  clustering  algorithm  elects 
within  each  domain  a  Cluster  Head  (CH),  The  cluster  head  in  the 
subnet  acts  as  local  DNS  for  own  cluster  and  also  (redundantly)  for 
neighbor  clusters.  The  cluster  head  advertises  to  neighbors  and  the 
rest  of  the  network  its  connectivity,  members,  and  domain 
information.  The  advertising  protocol  plays  the  role  of  BG  Protocol, 

Geo-routing  is  the  main  packet  forwarding  scheme  in  GIDR, 
Assuming  that  all  nodes  are  equipped  with  GPS,  greedy  forwarding 
is  a  straightforward  routing  scheme  and  can  be  easily  standardized 
and  implemented  in  all  ^^coalition^^  nodes.  Moreover,  it  is  inherently 
scalable  and  is  **address^^  independent  (thus,  it  works  across  domain 
boundaries).  If  greedy  forwarding  fails,  the  packet  is  **directionally^^ 
forwarded  to  the  ^*most  promising”  node  along  the  advertised 
direction,  i,e,,  direction  forwarding.  The  experiments  have  shown 
that  the  proposed  inter-domain  routing  has  achieved  scalability  and 
robustness  to  mobility.  The  simulation  results  with  Airborne 
Backbone  Network,  an  important  application  domain  in  Military,  as 
one  of  the  domains  are  also  presented  in  the  paper, 

1.  Introduction 

Nowadays,  the  inter-domain  routing  for  MANETs  (Mobile  Ad 
Hoe  Networks)  draws  more  and  more  attention.  The  existing  Border 
Gateway  Protoeol  (BGP)  is  the  de  faeto  inter-domain  routing  protoeol 
for  the  Internet.  But  BGP  is  not  applieable  to  MANETs  beeause  BGP 
design  is  based  on  a  statie  Internet,  and  eannot  seale  to  mobile, 
dynamie  topology  environments.  The  ehallenges  in  wireless,  mobile 
inter-domain  routing  inelude  dynamie  network  topology,  intermittent 
eonneetivity,  membership  management,  and  routing  protoeol 
heterogeneity. 

To  meet  the  above  ehallenges,  the  proposed  geo-based  inter¬ 
domain  routing  (GIDR)  protoeol  tries  to  aehieve  sealability  in  the  faee 
of  mobility  by  using  geo-routing  paeket  forwarding  seheme  and 
elustering  teehnique.  The  basie  strueture  of  GIDR  is  elusters  in  eaeh 
domain.  The  distributed  elustering  algorithm  eleets  within  eaeh 
domain  a  Cluster  Head  (CH).  The  eluster  head  in  the  subnet  aets  as 
loeal  DNS  for  own  eluster  and  also  (redundantly)  for  neighbor  eluster. 
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The  eluster  head  advertises  to  neighbors  and  the  rest  of  the  network  its 
eonneetivity,  members,  and  domain  information.  The  advertising 
protoeol  plays  the  role  of  BG  Protoeol. 

Geo-routing  is  the  main  paeket  forwarding  seheme  in  GIDR. 
Assuming  that  all  nodes  are  equipped  with  GPS,  greedy  forwarding  is  a 
straightforward  routing  seheme,  whieh  forwards  the  paeket  to  the 
neighbor  yielding  the  most  progress  towards  the  destination.  Greedy 
forwarding  ean  be  easily  standardized  and  implemented  in  all 
“eoalition”  nodes.  Moreover,  it  is  inherently  sealable  and  is  “address” 
independent  (thus,  it  works  aeross  domain  boundaries). 

The  most  delieate  aspeet  of  eonventional  Geo-Routing  (and  a 
damper  to  interoperability)  is  the  eireumvention  of  obstaeles  and 
“holes”  using  perimeter  routing  (a.k.a.  faee  routing)  methods.  Perimeter 
routing  greatly  degrades  performanee.  Moreover,  no  elear  prevailing 
perimeter  routing  standard  exists  that  will  work  well  in  all  situations. 
This  problem  is  bypassed  by  the  use  of  direetional  forwarding  in  GIDR. 
If  greedy  forwarding  fails,  the  GIDR  paeket  is  “direetionally” 
forwarded  to  the  “most  promising”  node  along  the  advertised  direetion. 

The  proposed  GIDR  protoeol  has  the  following  key  eharaeteristies 
and  innovations:  1)  Ability  to  handle  frequent  network  topology 
ehanges  by  exploiting  group  affinity  during  eluster  formation;  2) 
Dynamie  diseovery  and  dynamie  split/merge;  3)  Smaller  routing  table 
size  and  lower  routing  update  frequeney  by  the  Geo-routing  seheme 
(i.e.,  Greedy  Forwarding  +  Direetion  Forwarding);  4)  Member  Digest 
implementation  with  Bloom  Filter,  enhaneing  GIDR  sealability;  5)  eaeh 
MANET  in  GIDR  preserves  its  legaey  routing  seheme,  yet  membership 
ean  evolve  in  time  (split/expand/merge);  and  6)  Sealable  to  size  and 
robust  to  mobility. 

The  rest  of  the  paper  is  organized  in  the  following  way.  The  related 
work  is  briefly  reviewed  in  seetion  II.  We  deseribe  the  protoeol  design 
on  GIDR  in  details  in  seetion  III.  Intensive  performanee  evaluations  are 
presented  in  seetion  IV  and  we  eonelude  in  seetion  VI. 

IT  Related  Work 

We  briefly  review  previous  approaehes  related  to  inter-domain 
routing. 

2. 1  Border  Gateway  Protocol  (BGP) 

Inter-domain  routing  enables  interoperations  among  heterogeneous 
domains  that  usually  employ  different  routing  protoeols  and  polieies. 
The  Border  Gateway  Protoeol  (BGP)  [3,  4]  is  the  de  faeto  inter-domain 
routing  protoeol  for  the  Internet.  BGP  provides  a  standard  meehanism 
for  inter-domain  routing  among  heterogeneous  domains  or  autonomous 
systems  (AS).  The  prineiple  of  BGP  is  to  enable  opaque  interoperation, 
where  eaeh  domain  has  the  administrative  eontrol  over  its  intra-domain 
routing  protoeol  and  inter-domain  routing  poliey.  In  BGP,  the  routes  to 
an  internal  destination  within  the  same  domain  are  determined  by  an 
intra-domain  routing  protoeol,  whereas  the  routes  to  an  external 
destination  are  determined  by  the  inter-domain  routing  polieies  among 
domains.  BGP  relies  on  a  path  veetor  protoeol  for  exehanging  inter¬ 
domain  level  reaehability  information.  One  of  the  advantages  of  the 
path  veetor  protoeol  is  that  it  makes  it  easy  to  deteet  a  loop  in  a  route. 
Also  it  makes  it  easy  to  speeify  domain  administrator’s  preferenees  in 
the  route  seleetion  thereby  enabling  a  poliey-based  routing.  Despite 
several  reported  ineffieieneies,  BGP  has  been  operating  non  stop  in  the 
Internet  for  the  past  two  deeades.  There  is  a  vast  body  of  literature  on 
BGP  and  its  properties,  ineluding  sealability,  eontrol  0/H  and  seeurity. 
However,  these  results  are  not  direetly  applieable  to  MANETs  beeause 
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BGP  design  is  based  on  a  statie  Internet,  and  eannot  survive  in  mobile, 
dynamie  topology  environments. 

For  example,  BGP’s  eapability  to  handle  large  numbers  of  routes 
makes  it  potentially  valuable  to  large  seale  taetieal  networks. 
However,  large  seale  eauses  slow  eonvergenee  after  routing  ehanges. 
This  is  obviously  not  a  signifieant  issue  in  terrestrial  networks,  sinee 
links  are  generally  very  stable.  But  these  BGP  limitations  are 
intensified  by  the  MANET  environment.  Frequent  network  topology 
ehanges  are  possible  due  to  the  node  movement  in  MANETs.  Links 
ean  appear  and  disappear  very  quiekly  in  this  environment.  Sinee  BGP 
uses  TCP  for  reliable  eontrol  message  exehange,  it  will  be  extremely 
vulnerable  in  sueh  mobile  environment.  Likewise,  BGP  eannot  support 
dynamie  diseovery  of  its  members. 

2.2  Other  Previous  Work  (Besides  BGP) 

There  are  other  proposals  to  enable  inter-domain  eommunieations 
in  the  literature.  Most  of  them  foeus  on  high  level  arehiteetures  and 
provide  sketeh  of  required  eomponents,  e.g.,  the  translation  of  naming 
spaees,  protoeol  translation,  BGP-style  routing,  and  support  for  node 
mobility.  Croweroft  et  al.  proposed  Plutareh  as  arehiteeture  to  translate 
address  spaees  and  transport  protoeols  among  domains  to  support 
interoperation  of  heterogeneous  networks  [5].  TurfNet  is  another 
proposal  for  inter-domain  networking  without  requiring  global 
network  addressing  or  a  eommon  network  protoeol  [6]. 

2.2. 1  Mobile  Ad  hoc  Inter- domain  Networking  (MAIN)  Framework 

The  MAIN  (Mobile  Ad  hoe  Inter-domain  Networking) 
framework  reeently  proposed  by  [2,  1]  assumes  that  eaeh  MANET 
funetions  as  an  autonomous  system  (AS)  in  the  extended  wireless 
Internet.  It  requires  speeial  gateway  nodes  in  the  networks.  MAIN 
supports  the  poliey-based  routing,  and  relies  on  path  veetor  protoeol  to 
support  poliey-based  routing.  In  MAIN,  the  system  of  inter-eonneeted 
MANETs  is  assumed  to  be  traffie  driven,  i.e.  reaetive  rather  than 
proaetive.  Thus  MAINS  proposes  a  reaetive  path  veetor  protoeol.  The 
proposed  framework  requires  no  surrender  of  the  administrative 
eontrol  by  eaeh  domain.  Thus  eaeh  domain  ean  use  its  native  intra¬ 
domain  routing  protoeols  without  ehange,  and  speeify  inter-domain 
routing  polieies  in  the  spirit  of  the  poliey-based  routing  as  supported 
by  BGP  in  the  Internet. 

But,  there  are  several  open  issues  that  MAIN  needs  to  handle:  (a) 
partition  and  merge  of  domains;  (b)  membership  announeement;  (e) 
gateway  fiinetion  design;  and  (d)  support  for  poliey  based  routing.  The 
first  two  points  are  due  to  node  mobility  and  dynamie  topology,  and 
the  latter  two  are  general  issues  with  inter-domain  routing  with 
autonomy  of  eaeh  domain. 

2.2.2  Interconnecting  Heterogeneous  Routing  solutions 

Heterogeneous  routing  is  a  problem  that  must  be  faeed  when 
intereonneeting  MANETs.  There  have  been  proposals  to  take 
advantage  of  heterogeneous  routing  protoeols  to  adapt  to  network 
dynamies  and  traffie  eharaeteristies.  Hybrid  routing  protoeols  eombine 
different  style  routing  protoeols  and  adaptively  use  them  to  improve 
the  performanee  in  a  single  domain.  For  example,  SHARP  [7]  is  an 
adaptive  hybrid  routing  protoeols  that  uses  both  proaetive  and  reaetive 
routing  protoeols  to  balanee  the  tradeoff  between  the  two  and  improve 
the  performanee.  To  aehieve  this  goal,  SHARP  ereates  proaetive 
routing  zones  around  nodes  with  heavy  traffie,  and  uses  a  reaetive 
routing  in  other  areas.  Although  hybrid  routing  eombines  different 
routing  protoeols,  its  main  goal  is  to  improve  performanee  in  a  single 
zone  via  adaptation.  On  the  eontrary,  this  proposal  studies  the  inter¬ 
networking  of  heterogeneous  routing  domains;  it  seeks  solutions  that 
are  independent  of  the  speeifie  internal  routing  protoeols. 

Cluster-based  networking  [8]  (sueh  as  LANMAR  [II],  ZRP  [12]) 
is  similar  to  inter-domain  routing  in  that  it  is  also  eoneerned  with  the 
interaetion  among  elusters  of  nodes  at  the  network  layer.  The  idea  of 
eluster-based  networking  is  to  form  self-organizing  elusters  and  a 
routing  baekbone  among  eluster  heads.  In  this  way,  eluster-based 


networks  ean  aehieve  a  sealable  routing  in  a  single  domain.  Although 
eluster-based  routing  has  a  struetural  similarity  with  inter-domain 
routing,  there  are  fundamental  differenees.  Inter-domain  routing  deals 
with  multiple  heterogeneous  domains  with  autonomous  eontrol;  the 
hierarehy  of  the  network  (i.e.  domains)  is  given.  On  the  other  hand,  in 
elassie  eluster-based  routing  the  nodes  are  aggregated  to  form  elusters. 
Normally  Cluster-based  networking  is  based  on  geographie  proximity 
of  the  nodes.  Thus  it  is  more  appropriate  for  a  stationary  rather  than 
mobile  network. 

III.  Protocol  Design 

3. 1  Assumptions  and  Design  Goals 

In  the  proposed  GIDR  protoeol,  the  following  assumptions  are 
made.  Sueh  assumptions  are  eommon  when  making  inter  domain 
routing  [1][2]. 

•  The  node  IDs  are  unique  throughout  the  entire  network.  This 
is  a  valid  assumption  in  that  we  ean  simply  use  the  physieal 
address  (i.e.,  MAC  address)  of  eaeh  node  as  its  node  ID, 
whieh  guarantees  a  eertain  promise  of  uniqueness. 

•  The  domain  IDs  are  unique  aeross  the  whole  network.  This 
only  means  originally  the  domain  IDs  are  unique,  and  when 
domain  splits  we  will  use  pseudo  random  generator  to 
generate  new  domain  IDs  to  retain  this  property. 

•  The  eommunieations  between  inter-domain  gateways  are 
bidireetional.  This  is  also  assumed  in  [I,  2]. 

•  Domains  are  initially  pre-assigned.  Nodes  in  a  domain 
normally  running  the  same  routing  protoeol.  A  domain  may 
have  multiple  elusters  depending  on  task  assignments. 

•  Domain  may  be  split  due  to  node  mobility  or  tasks  ehanged, 
but  nodes  ean  merge  and  eombine  into  new  domains  only  if 
they  are  originally  from  the  same  domain.  Sinee  only  nodes 
using  the  same  intra-domain  routing  will  be  able  to  be 
eombined  into  a  same  domain,  this  assumption  is  self- 
validate. 

Besides  the  above  assumptions,  GIDR  assumes  that  all  nodes  are 
equipped  with  GPS,  whieh  is  eommon  in  military  MANETs,  sueh  as 
Airborne  Baekbone  networks. 

The  design  of  GIDR  tries  to  meet  the  ehallenges  in  the  inter¬ 
domain  routing  in  MANETs.  In  the  meantime,  GIDR  tries  to  bear  the 
following  properties: 

•  Sealability  with  network  seale.  Sinee  the  ad-hoe  domain  may 
have  a  large  seale,  GIDR  should  be  sealable  with  respeet  to 
the  node  numbers. 

•  Robustness  to  mobility.  Nodes  in  MANETs  normally  move 
frequently.  The  insensitivity  to  node  motion  is  one  of  the 
goals  of  GIDR. 

•  Independent  of  intra-domain  routing  protoeols.  This  means 
that  the  proposed  GIDR  protoeol  does  not  require  the 
fiinetionality  of  the  underlying  intra-domain  routing.  Beeause 
heterogeneous  intra-domain  routing  protoeols  exist  in 
different  domains,  this  property  of  GIDR  will  allow  it  to  adapt 
to  different  domains. 

3.2  Basic  Structure:  Clusters 

The  basie  strueture  of  GIDR  is  elusters  forming  by  the  elustering 
teehniques,  whieh  helps  GIDR  to  obtain  effieient  eommunieation 
among  MANETs  and  to  aehieve  sealability  in  large  networks. 

The  proposed  approaeh  exploits  the  elustering  by  group  affinity.  In 
eaeh  domain,  the  distributed  elustering  algorithm  diseovers  the  set  of 
“traveling  eompanions”  -  these  are  the  nodes  that  stiek  together  as  a 
group  for  some  time  or  for  some  eommon  tasks.  It  eleets  within  eaeh  set 
a  Cluster  Head  (CH)  for  eaeh  affinity  group  (Note  that  a  eluster  ean 
have  several  eluster  heads  to  obtain  effeetive  eommunieations  among 
domains).  Affinity  is  defined  in  terms  of  some  eommon  eharaeteristies, 
sueh  as  group  motion  or  same  tasks.  The  elusters  (i.e.,  subnets)  are 
defined  a  priori  or  evolve  dynamieally  by  the  affinity  of  geography. 


motion,  or  task.  The  cluster  head  in  the  subnet  acts  as  local  DNS  for 
own  cluster  and  also  (redundantly)  for  neighbor  clusters.  The  cluster 
head  advertises  to  neighbors  and  the  rest  of  the  network  its 
connectivity,  members,  and  domain  information  (such  as  Autonomous 
System  (AS)  Id,  etc).  The  advertising  protocol  plays  the  role  of  BG 
Protocol. 

Note  that  the  clustering  algorithm  requires  periodic 
communications  between  nodes  in  the  underlying  pool  nodes  that  are 
candidates  to  become  members  in  the  cluster.  If  the  cluster  uses  a 
proactive  routing  algorithm,  e.g.  OLSR,  the  routing  algorithm  itself 
can  be  used  for  cluster  creation  and  cluster-head  election.  In  the  case 
of  on-demand  routing  like  AODV  and  DSR,  a  separate  periodic 
algorithm  such  as  Distance  Vector  must  be  implemented  to  support  the 
cluster  functions  and  to  propagate  the  cluster  head  advertisements 
across  the  cluster. 

In  GIDR,  cluster  heads  (CH)  function  as  gateways  among 
domains  and  thus  they  can  understand  the  messages  or  control  packets 
from  other  domains.  The  control  packet  (i.e.,  the  routing  update 
packet)  contains  the  topology  table  (including  geo-locations  of 
neighbors,  etc.),  the  member  list,  and  the  AS  Id  of  a  cluster  head.  The 
information  exchanged  among  cluster  heads  makes  it  possible  to 
efficiently  communicate  with  other  CHs  in  different  domains.  They  are 
also  able  to  detect  domain  split  and  isolated  nodes.  The  DSDV 
information  exchange  allows  the  proposed  protocol  to  be  independent 
of  specific  intra-domain  routing  protocols.  On  the  other  hand,  non-CH 
nodes  can’t  understand  the  control  packets  from  other  domains,  but 
they  will  forward  these  control  packets  to  their  CHs. 

Once  the  clusters  are  created  and  the  cluster  heads  elected,  the 
routing  is  a  two  level  operation.  In  the  proposed  protocol,  packets  to 
remote  nodes  are  routed  via  cluster-head  advertised  routes,  and  packets 
to  local  destinations  are  routed  using  the  local  routing  algorithm.  The 
cluster-head  advertised  route  is  discussed  in  details  in  next  session  3.3. 

3.3  Core  Routing  Components:  Geo-DFR 

Geo-DFR  is  of  particular  interest  in  multi-domain  MANET 
scenarios,  where  a  cluster  head  is  elected  in  each  domain  and 
propagates  advertisements  to  the  other  domains.  GIDR  uses  Geo-DFR 
(Greedy  Forwarding  +  Direction  Forwarding)  as  its  core  components 
to  route  among  domains.  The  packet  travels  from  the  source  node’s 
cluster  head  to  the  destination  node’s  cluster  head  by  using  Geo-DFR 
[14].  From  the  latter  it  is  delivered  to  the  destination  node  via  local 
routing  protocol. 

Geo-DFR  is  a  geographical  based  routing  scheme.  The  key  idea 
of  Geo-routing  [13]  is  known  that  each  node  knows  its  geo-coordinates 
either  from  GPS  or  Galileo,  and  the  source  knows  the  destination  geo¬ 
coordinates  and  stamps  it  in  the  packet.  At  each  hop,  the  packet  is 
forwarded  to  the  neighbor  closest  to  destination.  Some  forwarding 
schemes  are  used  in  Geo-routing,  such  as  Greedy  forwarding. 
Perimeter  forwarding  and  Direction  forwarding.  In  Geo-DFR, 
direction  forwarding  is  designed  to  complement  and  even  replace 
Perimeter  forwarding  in  dead  end  recovery.  A  packet  in  Geo-DFR  is 
first  forwarded  to  the  neighbor  which  yields  the  most  progress  towards 
the  destination,  i.e.,  greedy  forwarding.  If  greedy  forwarding  fails,  the 
packet  is  “directionally”  forwarded  to  the  “most  promising”  node 
along  the  advertised  direction. 

Figure  1  is  the  comparison  between  geo-routing  (i.e..  Greedy 
Forwarding  here)  and  Geo-DFR.  It  also  shows  how  direction 
forwarding  in  Geo-DFR  helps  packets  to  detour  from  a  “hole”,  i.e.,  an 
obstacle.  The  upper  part  of  Figure  1  illustrates  the  Geo-routing  using 
greedy  forwarding.  When  the  node’s  routing  run  into  a  “hole”,  the 
greedy  forwarding  terminated,  and  the  routing  path  fails  because  of  the 
“hole”.  The  lower  part  of  Figure  1  shows  the  functionality  of  Geo- 
DFR.  Each  of  nodes  in  Geo-DFR  calculates  the  direction  to  the 
destination.  If  the  greedy  forwarding  fails  because  of  the  “hole”,  the 
backup  direction  forwarding  in  Geo-DFR  will  be  used  to  select  the 
next  hop  for  the  further  forwarding  packets. 
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Figure  1:  Comparison  between  Geo-routing  and  Geo-DFR. 

The  direction  forwarding  in  Geo-DFR  chooses  the  next  hop  based 
on  the  direction  of  each  node  to  the  destination  which  is  calculated 
when  the  routing  update  received.  Also,  if  multiple  updates  are  received 
at  the  same  time  from  different  neighbors  with  same  hop  distance  and 
sequence  number,  the  direction  will  be  calculated  by  the  vector  sum  of 
directions.  Figure  2  gives  an  example  to  illustrate  the  computing  of  the 
direction.  Suppose  Node  A  receives  direction  update  packets  from  Node 
B  and  Node  C,  the  direction  to  the  destination  is  the  vector  sum  of 
direction  from  Node  A  to  Node  B  and  the  direction  from  Node  A  to 
Node  C.  It  is  marked  with  red  color  in  Figure  2. 


Figure  2:  Computing  the  direction  to  the  destination. 


By  using  Geo-DFR,  each  node  remembers  the  “direction”  on  the 
way  to  each  cluster  head  in  the  same  domain.  The  node  knows  which 
zone  can  be  reachable  from  the  cluster  head.  Among  domains,  cluster 
heads  perform  the  Geo-DFR  protocol  to  find  an  adoptive  way  to  the 
destination  as  shown  in  Figure  3.  Within  the  domain,  an  intra-domain 
routing  protocol  such  as  DSDV,  AODV  is  used.  The  GIDR  inter¬ 
domain  routing  protocol  chooses  the  routing  path  which  is  marked  by 
red  lines  from  S  to  D  in  Figure  3. 


3. 4  Member  Digest  with  Bloom  Filter  for  Membership  Management 

The  membership  management  in  an  inter-domain  routing  among 
MANETs  is  a  ehallenge.  The  prefix  based  routing  of  BGP  does  not 
work  sinee  gateways  are  not  able  to  aggregate  domain  members  by 
suitable  IP  prefix. 

Global  gateways  eoordination  and  reassign  node  IDs  so  that  eaeh 
node  has  a  unique  prefix,  whieh  is  not  feasible.  In  the  proposed  GIDR 
protoeol,  the  domain  membership  information  is  advertised  in  the  form 
of  membership  digest.  The  advertised  eontrol  paeket  broadeast  by  the 
CH  node  (i.e.,  gateway)  eontains  the  member  digest  of  that  domain. 

Using  a  plain  member  list  in  the  eontrol  paeket  by  a  CH  is  eostly 
when  the  network  beeomes  large.  Bloom  Filter  [16]  is  the  teehnique  to 
map  a  member  list  to  a  bit  veetor,  in  whieh  the  membership 
verifieation  operation  ean  be  earried  out  within  0(1)  operations  instead 
of  0(m)  operations  {m  is  the  member  eount)  required  by  the  plain 
member  list.  When  a  Bloom  Filter  is  used  to  represent  the  member  list 
of  a  eluster,  the  size  of  the  eontrol  paeket  advertised  by  CH  is  mueh 
smaller  than  the  size  of  the  eonventional  eontrol  paeket  whieh  eontains 
a  plain  member  list.  Thus  the  proposed  GIDR  protoeol  beeomes  more 
sealable  by  taking  advantage  of  the  Bloom  Filter. 

Figure  4  shows  the  eonstruetion  of  the  Bloom  Filter  aeeording  to 
a  plain  member  list.  A  bit  veetor  of  m  bits  is  used  to  represent  a  set  of 
n  members  {idi,  id2,  idj.  Originally  all  the  bits  in  the  Bloom  Filter 
are  set  to  '0\  By  hashing  eaeh  item  using  a  hash  fiinetion  of  log2(m) 
bits,  the  Bloom  Filter  will  set  the  eorresponding  bit  to  ‘7’.  To  eheek 
the  membership  of  the  element  x,  it  is  suffieient  to  verify  whether  the 
bit  eorresponding  to  h(x)  is  set  to  ‘7’.  The  verifieation  will  eause  false 
positive,  i.e.,  an  element  not  belonging  to  the  set  may  be  eheeked  as  a 
member.  But  Bloom  Filter  is  free  from  false  negatives,  i.e.,  any 
element  verified  as  a  non-member  shall  not  belong  to  the  set.  Many 
hash  fiinetions  sueh  as  MD5  and  SHA-1  are  evenly  distributed  in  the 
‘bit  veetor’  domain,  so  the  false  positive  probability  ean  be  deereased 
to  a  large  extent. 

Plain  member  digest  MD  Bloom  Filter 


Figure  4:  Using  Bloom  Filter  to  Compress  the  Member  List. 

3. 5  Domain  Split  and  Isolated  Nodes 

In  the  proposed  GIDR  protoeol.  Cluster  heads  (CHs)  send 
periodie  beaeons  to  deteet  domain  split.  If  one  CH  eannot  hear  any 
beaeon  from  other  CHs  within  the  same  domain,  GIDR  eonsiders  the 
domain  as  partitioned  into  diseonneeted  eomponents.  A  regular  (non- 
CH)  node  within  the  domain  will  respond  with  an  aeknowledge 
message  upon  reeeiving  the  first  beaeon  message  from  one  of  the  CHs 
in  the  same  domain.  If  regular  nodes  do  not  reeeive  any  beaeon 
message  within  a  timeout  threshold,  they  will  eonsider  themselves  as 
isolated  nodes  and  trigger  the  new  CH  eleetion  algorithm  to  eleet  a 
new  CH  within  these  isolated  nodes. 

Either  domain  split  or  isolated  nodes  will  trigger  the  birth  of  a 
new  domain.  A  new  AS  ID  needs  to  be  generated.  The  member  digest 
information  and  the  timestamp  of  the  new  domain  are  fed  into  a 
pseudo  random  fiinetion,  whieh  will  generate  a  new  AS -ID  for  the 


new-born  domain.  The  new  AS-ID  is  guaranteed  to  be  different  from 
existing  AS -IDs. 

In  the  new-born  domain,  new  eluster  heads  need  to  be  eleeted. 
Eaeh  node  in  the  domain  triggers  CH-eleetion  algorithm  to  eleet  a  new 
CH.  Sinee  a  CH  with  better  eonneetivity  is  preferred,  the  CH-eleetion 
algorithm  will  elevate  the  node  with  the  most  neighbors  to  CH  rank. 
Using  a  neighbor  diseovery  seheme,  eaeh  node  will  know  its  number  of 
neighbors,  and  broadeast  this  number  to  its  neighbor.  If  it  does  not 
reeeive  a  neighbor  eount  greater  than  its  own  neighbor  eount,  it  will 
eleet  itself  as  the  CH.  Note  that  the  above  CH-eleetion  algorithm  is  also 
applied  to  CH-eleetion  proeesses  in  existing  domains. 

With  the  birth  of  eaeh  new  domain,  we  need  to  update  the  routing 
path  in  the  routing  tables  of  CHs  in  existing  domains.  Upon  reeeiving 
the  advertised  update  eontrol  paeket  from  new-born  domain,  the  CHs  in 
existing  domains  will  update  their  routing  tables  and  membership 
information  for  the  new-born  domain.  The  GIDR  protoeol  earefully 
adds  domain  information  in  order  to  prevent  domain  path  loop.  As  long 
as  the  reeeived  domain  ID  is  the  same  as  the  domain  ID  on  the  existing 
domain  path,  the  advertised  domain  ID  will  be  abandoned. 


IV.  Performance  Evaluation 

GIDR  has  been  implemented  in  the  QualNet  net-work  simulator 

3.9.5  [9].  CBR  sourees  generate  network  data  traffie.  The  souree- 
destination  pairs  are  randomly  seleeted.  During  a  simulation  run  the 
number  of  eonneetions  is  fixed,  and  thus  the  input  traffie  load  is 
eonstant.  The  dimension  of  the  network  seenario  is  1500m  X  1500m. 
Different  seeds  are  used  in  the  simulations. 

The  mobility  model  is  RPGM  [10].  Eaeh  node  in  a  domain  has  a 
eommon  group  motion  eomponent.  In  addition,  eaeh  node  has  an 
individual  intra-group  motion  eomponent.  In  our  simulation  the  group 
speed  may  vary  under  different  seenarios,  while  the  intra-group  speed  is 
fixed  in  the  range  of  [0-5  m/s]  and  the  pause  time  is  10  seeonds. 

The  eommonly  used  metries  of  evaluating  routing  protoeols  for 
wireless  ad  hoe  networks  have  been  eonsidered:  1)  Paeket  Delivery 
Ratio:  the  ratio  of  the  number  of  data  paekets  delivered  to  the 
destination  nodes  over  the  number  of  data  paekets  transmitted  by  the 
souree  nodes;  and  2)  Control  Overhead:  the  total  number  of  eontrol 
paekets  for  all  delivered  data  paekets  during  the  whole  simulation  time. 

In  order  to  test  the  sealability  of  the  proposed  protoeol  and  its 
robustness  to  mobility,  its  performanees  in  various  seenarios  under 
different  total  node  numbers  and  different  CH  pereentages  are 
evaluated.  To  show  its  independeney  of  underlying  intra-domain 
routings,  we  also  tested  GIDR  with  multiple  domains  running 
heterogeneous  intra-domain  routing  protoeols.  The  benefit  of  Bloom 
Filter  applied  in  GIDR  is  also  evaluated.  To  show  the  advantage  of 
GIDR,  the  eomparisons  between  GIDR  and  CIDR  (Cluster-based  Inter- 
Domain  Routing),  whieh  is  naturally  developed  based  on  the  DSDV 
advertisement  in  the  forming  proeess  of  elusters  within  domains,  are 
also  evaluated.  The  simulation  results  with  TUrborne  Baekbone 
Network,  an  important  applieation  domain  in  Military,  as  one  of 
naturally  deployed  domains  are  also  presented  in  the  paper. 

The  simulation  parameters  eommon  to  all  experiments  are  as 
follows:  PHY/MAC  protoeol  is  IEEE  802. 1  Ib,  whieh  has  CSMA/CA 
with  RTS/CTS,  ehannel  eapaeity  of  2Mbps,  and  radio  range  of  375 
meters.  Total  simulation  time  is  900  seeonds. 

4. 1  Under  Different  Node  Numbers  and  CH  Percentages 

To  test  the  sealability  of  GIDR,  the  seenarios,  whieh  results  are 
depleted  in  Figure  5  and  6,  have  different  number  of  nodes  per  domain 
and  different  pereentages  of  eluster  heads.  The  pereentage  of  eluster 
heads  is  the  ratio  of  number  of  eluster  heads  over  total  node  number  in  a 
domain.  There  are  fixed  two  domains  running  different  underlying 
routing  protoeols  in  these  seenarios.  The  relationship  between  paeket 
delivery  ratio  and  different  node  number  &  CH  pereentage  is  shown  in 
Figure  5.  When  the  number  of  nodes  in  a  domain  inereases,  the 


delivery  ratio  drops  beeause  of  network  eongestion  and  rapid  inerease 
of  eontrol  overhead  (shown  in  Figure  6)  in  a  dense  network.  When 
adding  more  eluster  heads,  the  delivery  ratio  improves  quiekly  sinee 
eluster  heads  fiinetion  as  the  eommunieator  between  two  domains  and 
insuffieient  eluster  heads  may  reduee  the  eonneetivity  of  the  network 
and  thus  easily  drop  the  paeket. 


Figure  5:  Packet  Delivery  Ratio  vs.  #Nodes/Domain  &  Percentage  of 
CK 


Figure  6  shows  the  relationship  between  the  eontrol  overhead  and 
the  number  of  nodes  per  domain  &  the  pereentage  of  eluster  heads. 
Obviously,  when  more  nodes  exist  in  a  domain,  the  routing  eontrol 
overhead  of  intra-domain  inereases  a  lot.  The  size  of  routing  eontrol 
paeket  to  neighboring  domain  also  beeomes  bigger  beeause  of  more 
possible  routing  path  entries  in  the  domain.  As  we  notieed  in  Figure  5 
that  the  inereasing  eluster  heads  help  the  paeket  delivery,  but  it  eosts 
more  eontrol  overhead.  The  reason  is  that  eaeh  eluster  head  needs  to 
handle  the  routing  information  and  membership  within  the  eluster  and 
needs  to  broadeast  sueh  information  to  its  neighboring  eluster  heads. 
More  eluster  heads  thus  produee  more  eontrol  overhead. 
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Figure  6:  Control  Overhead  (OH)  V5.  #Nodes/Domain  &  Percentage 
ofCH. 

4.2  Under  Multiple  Domains 

In  order  to  show  the  GIDR  independeney  of  underlying  routing 
protoeols,  the  seenarios  of  Figure  7  and  8  have  multiple  domains,  eaeh 
of  whieh  runs  different  routing  protoeols,  sueh  as  AODV, 
BELLMANFORD,  FSRL,  LARI,  RIP,  or  OSPF,  ete.  In  these 
seenarios,  the  total  node  number  in  the  whole  network  is  fixed  as  120. 
As  shown  in  Figure  7,  the  paeket  delivery  ratio  drops  when  the  number 
of  domain  inereases.  When  the  paeket  transfers  aeross  more  domains, 
the  possibility  of  paeket  loss  inereases  sinee  the  paeket  needs  to  be 
routed  by  the  “eommunieator”  of  eluster  head  and  the  number  of 
eluster  head  in  eaeh  domain  is  limited.  As  we  ean  see  from  Figure  7, 
when  more  eluster  heads  are  generated,  the  paeket  delivery  ratio 


improves  sinee  more  eluster  heads  funetion  as  eommunieators  whieh 
reduee  the  paeket  loss. 


Figure  7:  Packet  Delivery  Ratio  Number  of  Domains. 


The  relationship  between  the  eontrol  overhead  and  number  of 
domain  is  shown  in  Figure  8.  When  the  number  of  domain  inereases, 
the  routing  overhead  drops.  In  the  seenarios  of  more  domains,  the  intra¬ 
domain  routing  eontrol  overhead  is  greatly  redueed  beeause  of  smaller 
number  of  members  per  domain.  The  update  frequeney  in  intra-domain 
is  normally  mueh  more  frequent  than  that  in  inter-domain.  Thus  the 
total  eontrol  overhead  is  less  in  the  seenarios  of  more  domains.  The 
same  trend  is  observed  when  the  pereentage  of  eluster  head  is  inereased. 
As  we  mentioned  earlier,  eluster  head  needs  to  generate  and  broadeast 
inter-domain  eontrol  paeket,  and  thus  more  eontrol  heads  produee  more 
eontrol  overhead. 


Figure  8:  Control  OverHead  V5.  Number  of  Domains. 

4. 3  Benefit  of  Bloom  Filter 

The  effeetiveness  of  bloom  filter  is  based  on  member  digest 
seheme.  In  our  simulation,  we  use  an  800-bit  bloom  filter  as  a  hash 
table  for  the  member  digest.  The  bloom  filter  always  eompresses  the 
member  digest  for  eaeh  domain  into  this  800-bit  hash  table.  Sinee  eaeh 
node  address  strueture  in  QualNet  is  32-bit,  this  bloom  filter  will 
introduee  more  overhead  than  a  plain  member  digest  when  node  number 
in  eaeh  domain  is  less  than  25  (e.g.,  800/32).  When  the  node  number  is 
greater  than  25,  bloom  filter  will  help  to  deerease  the  eontrol  overhead 
in  the  proposed  GIDR  protoeol.  Figure  9  elearly  indieates  this 
phenomenon.  In  Figure  9,  the  X-Axis  is  the  number  of  nodes  in  eaeh 
domain,  and  the  Y-Axis  is  the  eontrol  overhead  redueed  by  using  a 
bloom  filter  eompared  to  a  plain  member  digest  (i.e.,  the  overhead  of 
using  plain  member  digest  -  the  overhead  of  using  bloom  filter).  When 
the  node  number  in  a  domain  is  20,  this  reduetion  is  negative,  meaning 
that  the  bloom  filter  introduees  more  overhead  than  plain  member 
digest.  When  the  node  number  in  a  domain  is  equal  to  or  greater  than 
40,  the  bloom  filter  helps  to  alleviate  the  routing  eontrol  overhead.  Also 
we  ean  see  that  when  node  number  inereases,  the  reduetion  by  using 
bloom  filter  elearly  inereases. 
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Figure  9:  Effectiveness  of  bloom  filter  (BF)  based  member  digest 
scheme. 


Overhead:  80  nodes/domain,  2  domains,  20%  CH 
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Figure  11:  GIDR  CIDR  (Control  overhead  comparison  with 
variable  of  node  speed). 

4. 5  Internetworking  with  Airborne  Backbone  Networks 
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4.4  Compare  with  Pure  Cluster-based  Inter-domain  Routing  (CIDR) 
using  DSDV 

As  we  discussed  in  session  3.2,  CIDR  can  be  naturally  developed 
based  on  the  DSDV  advertisement  in  the  forming  process  of  clusters 
within  domains.  The  major  difference  between  GIDR  and  CIDR  is  that 
GIDR  uses  geo-based  routing  (i.e.  Geo-DFR)  among  domains,  but 
CIDR  applies  DSDV  instead. 

In  order  to  illustrate  the  advantage  of  GIDR  over  CIDR,  the 
scenarios  of  Figure  10  and  1 1  have  two  domains,  80  nodes  per  domain, 
and  20%  cluster  head  among  nodes  with  variety  of  velocity  from  10 
m/s  to  50  m/s.  The  comparison  results  of  delivery  ratio  between  GIDR 
and  CIDR  is  shown  in  Figure  10.  We  can  see  that  there  are  huge 
delivery  ratio  differences  between  GIDR  and  CIDR,  in  which  GIDR  is 
almost  35%  higher  than  CIDR  protocol.  The  reason  of  better 
performance  of  GIDR  over  CIDR  is  the  avoidance  of  stale  routing 
table  entries  when  using  Geo-DFR  in  GIDR.  The  problem  of  stale 
routing  table  entries  often  happens  in  CIDR  and  drops  packets  when 
using  DSDV  in  CIDR. 

Delivery  Ratio:  80  nodes/domain,  2  domains,  20%  gateway 
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Figure  10:  GIDR  CIDR  (Delivery  ratio  comparison  with  variable 
of  node  speed). 

Figure  11  shows  the  comparison  results  of  control  overhead 
between  GIDR  and  CIDR.  We  can  easily  observe  that  GIDR  generates 
much  lower  control  overhead  than  that  of  CIDR.  The  reason  is  that 
GIDR  protocol  does  not  need  to  take  so  accurate  routing  information 
as  CIDR  requires.  This  will  heavily  reduce  the  size  of  update  control 
packets  and  lower  routing  update  frequency  in  GIDR,  which  reduce 
the  control  overhead  of  GIDR  greatly.  Based  on  the  simulation  results 
of  Figure  10  and  11,  GIDR  shows  a  better  performance  than  CIDR,  no 
matter  in  the  aspect  of  delivery  ratio  or  control  overhead. 


GIDR  can  be  naturally  applied  in  the  Airborne  Network  (AN) 
scenarios.  Normally  all  of  the  nodes  in  airborne  networks  have  GPS- 
equipped,  thus  it  is  able  to  know  the  geo-locations  of  neighboring 
nodes.  The  backbone  nodes  in  the  airborne  networks  naturally  become 
the  cluster  heads  in  the  GIDR  protocol.  The  periodic  communications 
among  nodes  in  airborne  networks  provide  the  in-time  routing 
information  updates  needed  in  GIDR.  The  Mobility  aware  paradigm 
(MARP  [15]),  which  is  a  powerful  and  common  used  routing  scheme 
inside  one  domain  of  airborne  networks,  may  provide  future  geo¬ 
locations  for  nodes  in  airborne  networks.  This  feature  creates  a  more 
suitable  environment  to  apply  GIDR  in  airborne  networks. 

The  simulation  scenario  of  Airborne  Backbone  Network  is 
illustrated  in  Figure  12.  The  Airborne  Network  backbone  running 
MARP/MDP  is  composed  of  AWACs  1,  Rivet  Joint,  JointStars,  MC2A, 
GlobalHawk,  Predatorl,  Predator2,  U-2,  AWACS.  The  nodes  running 
BELLMANFORD  are  in  the  green  shaded  domain  containing  F-22,  F- 
15  and  F-22.  The  nodes  running  AODV  are  in  the  blue  shaded  domain 
containing  F-22(9),  F-15(10)  and  F-22(ll).  Each  aircraft  in  the 
Airborne  Network  can  be  treated  as  backbone  node  and  each  of  them 
can  become  a  cluster  head  in  GIDR.  The  backbone  nodes  in  the  AN  can 
then  communicate  with  cluster  heads  in  two  other  MANETs  under 
GIDR  protocol. 


Figure  12:  Simulation  Scenario  of  Airborne  Network. 

The  results  of  delivery  ratio  vs.  velocity  in  Airborne  Network 
scenarios  are  illustrated  in  Figure  13.  The  cluster  head  (CH)  number  of 
MANET  domains  in  Figure  13  and  14  is  fixed  as  1.  The  curve  with  red 
nodes  in  Figure  13  represents  the  performance  in  the  scenarios  where 


the  number  of  eluster  head  in  airborne  domain  is  1.  The  eurve  of  blue 
nodes  represents  the  seenarios  where  the  eluster  head  number  in 
airborne  domain  is  3.  The  pink  one  stands  for  the  seenarios  where  the 
airborne  domain  has  5  eluster  heads.  Figure  13  shows  that  the  delivery 
ratio  beeomes  lower  with  the  inereasing  of  the  veloeity  of  the  node. 
When  nodes  move  faster,  the  radio  links  among  nodes  are  frequently 
ehanged,  whieh  eauses  weaker  node  eonneetivity  and  thus  reduees  the 
paeket  delivery  ratio.  The  relationship  between  the  eontrol  overhead 
and  node  veloeity  is  shown  in  Figure  14.  The  seenarios  are  the  same  as 
Figure  13.  With  the  inerease  of  node  speed,  the  routing  eontrol 
overhead  slightly  inereases  beeause  the  faster  node  movement  may 
produee  more  but  not  mueh  more  routing  update  paekets. 


Figure  13:  Delivery  Ratio  V5.  Different  Velocity  (Airborne  Network 
Scenario). 


♦  5  CHsmNIARP  donaln 


♦  3  CHs  in  NIARP  donnln 

♦  1  CH  in  MARP  domain 


Figure  14:  Control  Overhead  Different  Velocity  (Airborne  Network 
Scenario). 


V.  Conclusions 

The  proposed  GIDR  protoeol  aehieves  sealability  in  large 
networks  by  using  Geo-DFR  paeket  forwarding  seheme  and  elustering 
teehnique.  The  basie  strueture  of  GIDR  is  elusters  in  eaeh  domain.  The 
proposed  approaeh  exploits  the  elustering  by  group  affinity.  The 
eleeted  eluster  head  in  the  subnet  aets  as  loeal  DNS  for  own  eluster 
and  also  for  neighbor  elusters.  The  eluster  head  advertises  to  neighbors 
and  the  rest  of  the  network  its  eluster  information.  The  advertising 
protoeol  plays  the  role  of  BG  Protoeol. 

GIDR  applies  Geo-DFR  as  its  main  paeket  forwarding  seheme 
among  domains.  A  paeket  in  GIDR  is  first  greedy  forwarded  to  the 
neighbor  whieh  yields  the  most  progress  towards  the  destination 
eluster  head.  If  greedy  forwarding  fails,  the  paeket  is  “direetionally” 
forwarded  to  the  “most  promising”  node  along  the  advertised 
direetion. 

The  experiments  have  shown  that  the  proposed  inter-domain 
routing  has  aehieved  the  sealability  in  large  network,  the  robustness  to 
mobility,  and  the  independeney  of  underlying  intra-domain  routing 
protoeols.  Compared  to  CIDR  using  DSDV,  GIDR  saves  the  routing 


table  size,  reduees  the  update  frequeney  and  avoids  stale  routing  table 
entries,  thus  it  produees  higher  delivery  ratio  and  lower  eontrol 
overhead  than  CIDR.  The  simulation  results  with  Airborne  Baekbone 
Network,  an  important  applieation  domain  in  Military,  as  one  of  the 
domains  are  also  presented  in  the  paper. 
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